Audio-visual Perception of Humans for a Humanoid Robot
نویسندگان
چکیده
We present a combined system that enables a humanoid robot to sense humans using different modalities. The user is localized by means of a joint audio-visual person tracker. His face is identified using a novel local-appearance based approach which is robust against partial occlusion. In order to determine the user’s focus and object of interest respectively, we estimate headpose using a neural-network classifier and recognize pointing gestures based on hand motion.
منابع مشابه
Human Perception of Audio-Visual Synthetic Character Emotion Expression in the Presence of Ambiguous and Conflicting Information
Computer simulated avatars and humanoid robots have an increasingly prominent place in today’s world. Acceptance of these synthetic characters depends on their ability to properly and recognizably convey basic emotion states to a user population. This study presents an analysis of the interaction between emotional audio (human voice) and video (simple animation) cues. The emotional relevance of...
متن کاملFlexible Foot/Ankle Based on PKM with Force/Torque Sensor for Humanoid Robot
This paper describes the development of a novel humanoid robot foot/ankle based on an orientation Parallel Kinematic Mechanism for intelligent and flexible control. With three identical Universal-Prismatic-Spherical prismatic-actuated limbs and a central Universal-Revolute passive limb, the PKM can perform three degrees of freedom rotation motions. In order to enable the humanoid robot safely t...
متن کاملA Multi-modal Approach for Assistive Humanoid Robots
Mobile assistive robots can enhance elderly people’s perception of safety and prevent loss of confidence at home. Therefore, multi-modal systems that allow robots to operate in complex environments represent an enticing milestone for self-care and independent living applications. We present a humanoid robot that assists a person in daily activities and detects situations of danger such as fall ...
متن کاملCan Real-Time, Adaptive Human-Robot Motor Coordination Improve Humans' Overall Perception of a Robot?
Previous research on social interaction among humans suggested that interpersonal motor coordination can help to establish social rapport. Our research addresses the question of whether, in a human-humanoid interaction experiment, the human’s overall perception of a robot can be improved by realising motor coordination behaviour that allows the robot to adapt in real-time to a person’s behaviou...
متن کاملThe Vernissage Corpus: a Multimodal Human-robot-interaction Dataset
We introduce a new multimodal interaction dataset with extensive annotations in a conversational Human-RobotInteraction (HRI) scenario. It has been recorded and annotated to benchmark many relevant perceptual tasks, towards enabling a robot to converse with multiple humans, such as speaker localization, key word spotting, speech recognition in audio domain; tracking, pose estimation, nodding, v...
متن کامل